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(54) IMAGE PROCESSING UNIT AND ITS METHOD 

(57)Abstract: 

PURPOSE: To realize an image processing unit and its 
method in which a kind of a received image is 
discriminated. 

CONSTITUTION: An image processing unit 102 
discriminates the kind of an image received from an 
image input device 101 and when the result of 
discrimination indicates an 1 image comprising a single 
density object simple thresholding is applied to the input 
image and when not pseudo intermediate tone 
thresholding is applied to the received image and the 
processed image is filed and registered in a storage 
device 103. Thus, when lots of images are filed, since the 
kind of the image is automatically discriminated, it is not 
required for the user to confirm the kind of each image. 
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* NOTICES * 



JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 
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[Claim(s)] 

[Claim 1] The image-processing approach characterized by having the operation step which 
searches for the luminance distribution from an input image, the division step which divides the 
luminance distribution acquired at said operation step at two or more brightness sections, and 
the distinction step which distinguishes the class of said input image based on the bias of each 
luminance distribution divided at said division step. 

[Claim 2] The first operation step which searches for the whole luminance distribution from an 
input image, and the division step which divides the whole luminance distribution acquired at said 
first operation step at two or more brightness sections, The second operation step which 
calculates the value showing the bias of each luminance distribution divided at said division step, 
The image-processing approach characterized by having the decision step which judges the 
configuration of said whole luminance distribution based on the result of an operation of said 
second operation step, and the distinction step which distinguishes the class of said input image 
from the configuration of said whole luminance distribution judged at said decision step. 
[Claim 3] Said division step is the image-processing approach indicated by claim 2 characterized 
by dividing said whole luminance distribution for the step which halves the luminance distribution 
bordering on the average of luminance distribution by predetermined time loop ****** at two or 
more brightness sections. 

[Claim 4] Said second operation step is the image-processing approach indicated by claim 2 
characterized by calculating the value showing the bias of the luminance distribution from the 
difference of each sampled value included in luminance distribution, and the average of the 
luminance distribution. 

[Claim 5] Said second operation step is the image-processing approach indicated by claim 4 
characterized by calculating the value showing the bias of said luminance distribution using the 
oddth power of said difference. 

[Claim 6] Said decision step is the image-processing approach indicated by claim 2 or claim 3 to 
which the value showing the bias of the luminance distribution divided toward the maximum side 
from the minimum value side of said brightness section is characterized by judging the 
configuration of said whole luminance distribution based on the count of change which changes 
to negative from forward. 

[Claim 7] Said decision step is the image-processing approach by which the value showing the 
bias of said luminance distribution was indicated by claim 6 characterized by judging that there is 
the minimum of the luminance distribution near the brightness section which changes from 
forward to negative. 

[Claim 8] Said distinction step is the image-processing approach indicated by claim 6 
characterized by distinguishing that it is the image which consisted of concentration objects with 
said single input image when the count of change obtained at said decision step was 1. 
[Claim 9] It is the image-processing approach indicated by claim 6 characterized by 
distinguishing that it is the image with which said input image consisted of concentration objects 
of two or more continuous tones for [ different ] concentration when the count of change which 
obtained said distinction step at said decision step is except one. 

[Claim 10] Furthermore, the image-processing approach indicated by any of claims 1-9 
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characterized by having the processing step which performs an image processing to said input 
image, and the storage step which makes a storage means memorize the image processed at 
said processing step based on the distinction result of said distinction step they are. 
[Claim 1 1] It is the image-processing approach indicated by claim 10 characterized by for said 
processing step performing simple binarization to said input image when it expresses the image 
with which said distinction result consisted of single concentration objects, and performing false 
halftone binarization to said input image when that is not right. 

[Claim 12] The image processing system characterized by having an operation means to search 
for the luminance distribution from an input image, a division means to divide the luminance 
distribution acquired by said operation means at two or more brightness sections, and a 
distinction means to distinguish the class of said input image based on the bias of each 
luminance distribution divided by said division means. 

[Claim 13] First operation means to search for the whole luminance distribution from an input 
image, and a division means to divide the whole luminance distribution acquired by said first 
operation means at two or more brightness sections, The second operation means which 
calculates the value showing the bias of each luminance distribution divided by said division 
means, The image processing system characterized by having a decision means to judge the 
configuration of said whole luminance distribution based on the result of an operation of said 
second operation means, and a distinction means to distinguish the class of said input image 
from the configuration of said whole luminance distribution judged by said decision means. 
[Claim 14] Furthermore, the image processing system indicated by claim 11 or claim 12 
characterized by having the input means for inputting said input image, a processing means to 
perform an image processing to said input image based on the distinction result of said 
distinction means, and a storage means to memorize the image processed by said processing 
means. 

[Claim 15] It is the image processing system indicated by claim 14 characterized by for said 
processing means performing simple binarization to said input image when it expresses the image 
with which said distinction result consisted of single concentration objects, and performing false 
halftone binarization to said input image when that is not right. 

[Translation done.] 
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DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to the image processing system which distinguishes 

the class of inputted image, concerning an image processing system and its approach 

[0002] 

[Description of the Prior Art] An image processing is performed to the image inputted with the 
scanner, and the electronic filing system saved as electronic intelligence is known. This 
electronic filing system is given to the image into which processing of the binarization for saving 
an image, image area separation, OCR (optical character recognition), filing registration, etc. was 
inputted regardless of the class of image. Here, image area separation is processing which 
divides an input image into fields, such as an alphabetic character, a photograph, a graph, and a 
table, and OCR is processing which recognizes an alphabetic character image and is changed 
into a character code. 
[0003] 

[Problem(s) to be Solved by the Invention] However, there were the following troubles in the 
above-mentioned conventional example. That is, since the same processing as an input image 
had been performed regardless of the class of image, the processing performed depending on the 
class of image is not sometimes appropriate. For example, when inputting the document 
containing a photograph, it is desirable to leave and carry out binarization of the gradation nature 
of a photograph, but since the image which performed simple binarization cannot reproduce 
gradation, a photograph part has the crushed problem. 

[0004] Moreover, although there is also an electronic filing system which can change processing 
according to the class of image, this changes processing based on the class of image which the 
user judged based on directions of a user that is, and the system itself judges the class of image 
and it does not change processing. For this reason, a user needs a time-consuming activity, 
when it is necessary to check that class about image each and files a lot of images. 
[0005] This invention is for solving an above-mentioned problem, and aims at offering the image 
processing system which can distinguish the class of inputted image, and its approach 
[0006] 

[Means for Solving the Problem] And [Function] This invention is equipped with the following 
configurations as a way stage which attains the aforementioned purpose. 

[0007] The image processing system concerning this invention is characterized by having the 
operation step which searches for the luminance distribution from an input image, the division 
step which divides the luminance distribution acquired at said operation step at two or more 
brightness sections, and the distinction step which distinguishes the class of said input image 
based on the bias of each luminance distribution divided at said division step. 
[0008] Moreover, the first operation step which searches for the whole luminance distribution 
from an input image, The division step which divides the whole luminance distribution acquired at 
said first operation step at two or more brightness sections, The second operation step which 
calculates the value showing the bias of each luminance distribution divided at said division step, 
It is characterized by having the decision step which judges the configuration of said whole 
luminance distribution based on the result of an operation of said second operation step, and the 
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distinction step which distinguishes the class of said input image from the configuration of said 
whole luminance distribution judged at said decision step. 

[0009] Moreover, the image-processing approach concerning this invention is characterized by 
having an operation means to search for the luminance distribution from an input image, a 
division means to divide the luminance distribution acquired by said operation means at two or 
more brightness sections, and a distinction means to distinguish the class of said input image 
based on the bias of each luminance distribution divided by said division means. 
[0010] Moreover, first operation means to search for the whole luminance distribution from an 
input image and a division means to divide the whole luminance distribution acquired by said first 
operation means at two or more brightness sections, The second operation means which 
calculates the value showing the bias of each luminance distribution divided by said division 
means, It is characterized by having a decision means to judge the configuration of said whole 
luminance distribution based on the result of an operation of said second operation means, and a 
distinction means to distinguish the class of said input image from the configuration of said 
whole luminance distribution judged by said decision means. 
[0011] 

[Example] Hereafter, the image processing system of one example concerning this invention is 
explained to a detail with reference to a drawing. 

[0012] Drawing 1 is the block diagram showing the outline configuration of the electronic filing 
system equipped with the image processing system of one example concerning this invention. 
[0013] In this drawing, it is a picture input device, for example, 101 consists of image scanners 
etc. and is for reading the image of the manuscript which is going to carry out a electronic filing 
system. 102 is the image processing system of this example, and performs processing later 
mentioned in the image inputted from the image scanner 101. 103 is a store, is equipped with a 
hard disk, an optical disk, or a magneto-optic disk as storage media, and memorizes the image 
outputted from the image processing system 102. 104 is an image output unit, for example, 
consists of monitors, such as CRT and LCD, or a printer, and forms an image based on the image 
information outputted from the image processing system 102. 

[0014] The image processing system 102 controlled actuation of a picture input device 101, 
storage 103, and the image output unit 104, generalized the whole electronic filing system, and is 
equipped with the function which searches and outputs a electronic filing system and the filed 
image. In addition, although an image processing system 102 can also be constituted as hardware 
of dedication, it is also realizable with the combination of a personal computer and the software 
for electronic filing systems, for example. Moreover, the image which carries out a electronic 
filing system may be an image formed from the document data created by what [ not only ] was 
formed on the recording paper etc. but word-processing software, and DTP software, or image 
data. 

[0015] Drawing 2 is a flow chart which shows an example of the procedure of the electronic filing 
system which an image processing system 102 performs. 

[0016] First, image data is inputted from a picture input device 101 at step S501. Here, the 
image data to input considers as 8-bit multiple-value data (8-bit gray scale), and the value 0 is 
made into black and it makes 255 white. 

[0017] Then, image distinction is performed at step S502. Two, the document with which 
complicated images, such as a document, a drawing, etc. which consist of simple images, and a 
photograph (it is called "the image for single concentration" below), drawing, have specifically 
been arranged, the document which has concentration change in the substrate, and the 
document (it is called below "the image for two or more concentration") with which the whole 
consists of photographs etc., are distinguished. 

[0018] And electronic filing system processing is performed at step S503. Binarization of the 
inputted multiple-value image data is specifically carried out, image area separation is performed, 
and OCR processing is performed to a text field by the image area separation result. Moreover, 
the image which carried out binarization carries out filing registration to storage 103 with the 
information by which the image for image retrieval is characterized. These processings are 
performed according to the class of image distinguished at step S502. That is, it carries out 
simple binarization, "the image for single concentration" separates an image area, performs OCR 
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processing to the text field, and carries out filing registration of the binary picture and character 

code which were obtained. On the other hand, after it performs the optimal binarization for image 

area separation first and removes the substrate, "the image for two or more concentration" 

separates an image area, performs simple binarization to an alphabetic character field, and 

carries out filing registration of the binary picture and character code which were obtained to it. 

Moreover, in an image field, false halftone binarization by the error diffusion method, a dither 

method, etc. is performed, and filing registration of the obtained binary picture is carried out to 
it. 

[0019] Drawing 3 is a flow chart which explains to a detail an example of the image distinction 
processing which the image processing system 102 of this example performs. 
[0020] In drawing 3, the multiple-value image which was inputted from the picture input device 
101 at step S1, and was once stored in storage 103 is inputted on memory. Then, the histogram 
of the multiple-value image inputted at step S2 is computed. Here, it asks for the frequency of 
the brightness value about all the pixels of an image. 

[0021] Next, at step S3, bordering on the average of the obtained histogram, the histogram is 
halved, the divided histogram is further halved by the average of each histogram, and four 
histograms are obtained. If this division is repeated n times, the histogram of the 2"n (2 n-th 
power) individual of the narrow brightness section will be obtained. In this example, it divides into 
eight histograms as n= 3. 

[0022] Next, the skew (Skew) statistic Sk of each histogram divided by step S4 is computed. 
Here, Sk value is a value showing the bias of frequency distribution, and is computed using a 
formula (1). 

SK = (sigma (Xi-AV)~3) /D — (1) D = sigma (Xi-AVT2 — (2), however Xi : Element of the 
population (brightness of a pixel) 

D: Variance AV of the whole population: Average a~b of the population: b-th power of a [0023] 
Cube of the difference of the population and its average AV is included in the formula of Sk 
value. This shows that it turns out that the bias of the population is in a larger side than the 
average AV when the sign of Sk value is forward, and the average AV also inclines toward the 
one where a bias is larger, so that Sk value is large. That is, the sign of Sk value shows the 
direction of the bias of luminance distribution, and the value shows the degree of a bias. In 
addition, they are Sk (1) and Sk (2) about Sk value of each histogram of small brightness width of 
face, in view of the brightness minimum value (that is, black side), It is referred to as — and Sk 
(2~n). 

[0024] Next, although later mentioned for details at step S5, a configuration judgment of a Homo 
sapiens gram is made from eight acquired Sk values, and the number of the troughs (minimum) of 
a histogram is outputted. Then, the class of image is distinguished from the number of the 
troughs obtained at step S6. The image which is an example of a brightness histogram when 
reading a simple document with a scanner, and has such a histogram is inputted, and drawing 4 
distinguishes from "the image for single concentration", when it judges that the number of the 
troughs is one. The image which is an example of a brightness histogram when reading a 
document and a drawing with concentration change with a scanner, and has such a histogram in 
the substrate is inputted, and drawing 5 distinguishes from "the image for two or more 
concentration", when it judges that there is the one or more number of troughs. 
[0025] Drawing 6 is a flow chart which shows an example of processing which investigates the 
number of the troughs of a histogram in step S5. 

[0026] First, the initial value 0 of the brightness section number k and a trough is substituted 
[ several i ] for step S151. Then, Sk(k) >0 is judged at step S152, Sk(k+1) <0 is judged at step 
S153, and if it is both truth, several i of a trough will be incremented at step S154. That is, when 
Sk value changes from forward to negative, it judges with there being a trough, 1 is added to 
several i of a trough at step S154, and when other, it jumps to step S155. 

[0027] Next, by judging k+K2"n at step S155, it judges and confirms whether the entire interval 
of luminance distribution was investigated, if an entire interval is investigated, processing will be 
ended, otherwise, the brightness section number k is incremented at step S156, and it returns to 
step S152. 

[0028] With the above procedure, the number of troughs can be investigated and the 
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configuration of a histogram can be judged. Next, a numeric value is actually shown and the 
distinction approach of the class of image is explained. 

[0029] Drawing 7 is drawing showing change of the brightness section when dividing the 
histogram shown in drawing 4, and an example of Sk value in each section. Since it assumes that 
the first section is a 8-bit multiple-value image, it is 0-255. The average AV in this section is 
177, and divides the section into 0-176, and 177-255. Furthermore, the average AV of the 
sections 0-176 is 91, and divides the section into 0-90, and 91-176. It divides like the following 
and the eight sections (k=1-8) are obtained. 

[0030] And Sk(3) =0.67, Sk(4) =0.94, Sk(5) =-4.46, Sk(6) =-1.04, Sk(7) =0.57, and Sk(8) =6.12 are 
obtained like [ Sk (1) value of the section k= 1 (0-42) / Sk (2) value of 7.08 and the section k= 2 
(43-90) ] -7.00 and the following. It is two places of a between [ between Sk (2) and Sk(s) (3) 
(from -7.00 to 0.67), Sk (6), and Sk(s) (7) (from -1.04 to 0.57) ] to have seen from the direction 
of the min of brightness and to have replaced the forward value from the negative value in these 
Sk values. That is, the image which could judge that there are two troughs in this histogram, 
consequently was shown in drawing 4 distinguishes that it is an image for two or more 
concentration. 

[0031] The electronic filing system which performed the image processing according to the class 
of image becomes possible by according to this example, asking for the frequency of the inputted 
multiple-value image, for example, brightness, calculating, the bias, i.e., Sk value, of frequency 
distribution of each histogram which repeated the histogram, and divided and obtained it based 
on the average, judging the configuration of a histogram from Sk value change, and distinguishing 
the class of multiple-value image, as explained above. For example, when it files the document 
with which a photograph is contained, it becomes possible to perform binarization processings 
for the images for two or more concentration (error diffusion method etc.), and to file the false 
halftone image which left the gradation nature of a photograph. Therefore, since the class of 
image can be automatically distinguished also in case a lot of images are filed, the activity whose 
user checks the class about image each can be done unnecessary 
[0032] 

[Modification(s)] In the example mentioned above, although the input image was used as the 8~ 
bit gray scale, it is not limited to this and can also input a color picture. That is, if it is multiple- 
value data, it will not matter at least at all even if there is much the number of bits. 
[0033] In the example mentioned above, although the example which performs an image 
processing was explained once memorizing an input image to storage 103, a direct histogram may 
be obtained by carrying out the PURISU can of the input image. Moreover, all pixels or every 
several pixels are sufficient as the sampling at the time of computing a histogram, and it is not 
limited especially. Furthermore, it is not necessary to perform count of an average value, 
Statistic Sk, etc. by 8 bits, and can also calculate with the smaller number of bits for 
improvement in the speed, memory deletion, etc. 

[0034] Moreover, in this example mentioned above, although the number of partitions of a 
histogram was set to 2~3 (eight division), this is decided experientially, is not suitably set up 
according to the bit depth of an input image etc., and is not limited to this. Moreover, although 
the example which divides a histogram into the histogram of the small brightness secti on with 
the average was explained, it may not limit to this, and the divisionHnto-equal-parts rate of the 
brightness section may be carried out simply, for example, the ratio of a pixel may divide for 
example, in a pitch 10%. 

[0035] Moreover, in the example mentioned above, although the class of image was made into 
two kinds, it does not limit to these two kinds, and further, you may classify more than three 
kinds, four kinds, and it, and not only the classification of "the image for single concentration" 
and the image for two or more concentration" but other classes may be set up as a class of 
image. 

[0036] In addition, even if it applies this invention to the system which consists of two or more 

devices, it may be applied to the equipment which consists of one device. 

[0037] Moreover, it cannot be overemphasized that this invention can be applied also when 

attained by supplying a program to a system or equipment. 

[0038] 
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[Effect of the Invention] As explained above, according to this invention, the image processing 
system which distinguishes the class of inputted image, and its approach can be offered. 

[Translation done.] 
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DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

ED rawing 1] The block diagram showing the outline configuration of the electronic filing system 

equipped with the image processing system of one example concerning this invention, 

I P rawin g, 2] The flow chart which shows an example of the procedure of the electronic filing 

system which the image processing system shown in drawing 1 performs, 

[Drawing 3] The flow chart which explains to a detail an example of the image distinction 

processing which the image processing system shown in drawing 1 performs, 

[Drawing_4] The example of a brightness histogram when reading a simple document with a 
scanner, 

[Drawing 5] The example of a brightness histogram when reading with a scanner the document 
and drawing which have concentration change in the substrate, 

.[Drawing J3] The flow chart which shows an example of processing which investigates the number 
of the troughs of a histogram in step S5 shown in drawing 3, 

[Drawing 7] It is drawing showing change of the brightness section when dividing the histogram 
shown in drawing 4, and an example of Sk value in each section. 
[Description of Notations] 

101 Picture Input Device 

102 [mage Processing System of this Example 

103 Storage 

104 Image Output Unit 



[Translation done.] 
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